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EXACT  SOLUTIONS  FOR  THE  TIME  CONSTANTS  OF  AN 
ADAPTIVE  ARRAY  IN  BANDLIMITED  NOISE 


I.  INTRODUCTION 

Adaptive  processors  are  the  subject  of  considerable  interest  for  a  variety  of  applications  in  the 
radar  and  communications  fields.  The  reason  for  this  interest  is  that  adaptive  processors  can  respond 
automatically  to  an  unknown  external  noise  environment  such  as  radar  clutter  or  man-made  interfer¬ 
ence  by  steering  nulls  in  the  direction  of  the  interfering  sources  and  at  the  same  time  maintain  a 
desired  signal  response. 

Widrow  [ll  has  defined  an  adaptive  processor  (filter  or  array)  to  be  a  filter  that  bases  its  own 
design  (its  internal  adjustment  settings)  upon  estimated  statistical  characteristics  of  the  input  and  output 
signals.  In  particular,  an  adaptive  spatial  array  processor  weights  the  coherent  output  from  each  sensor 
and  adds  them  to  form  a  receiving  beam.  For  an  adaptive  array  these  weights  may  not  be  constant,  but 
rather  can  change  as  a  function  of  the  spatial  properties  of  the  noise  field.  Historically,  the  adaptive 
filter  was  first  investigated  in  the  early  1960’s  by  Howells  [2)  and  Applebaum  13),  the  latter  of  whom 
discovered  the  control  law  which  maximizes  a  generalized  signal  to  noise  ratio.  A  few  years  later, 
Widrow  [4,5]  and  his  co-workers  derived  and  demonstrated  the  utility  of  a  least  mean  square  (LMS) 
algorithm  for  controlling  the  weights,  and  applied  their  approach  to  adaptive  RF  antenna  systems.  The 
LMS  algorithm  was  further  developed  by  Griffiths  [6)  and  Frost  [7]  who  found  procedures  for  main¬ 
taining  a  chosen  frequency  characteristic  for  an  array  in  a  desired  direction  while  nulling  out  noises 
coming  from  other  directions.  Compton  [8,91  and  Zahm  [10]  examined  the  use  of  the  LMS  algorithm 
as  a  power  equalization  technique  which  allowed  the  aquisition  of  weak  signals  in  the  presence  of  strong 
jamming.  Brennan  and  Reed  [11-13]  further  developed  the  Applebaum  maximum  signal  to  noise  ratio 
(MSN)  algorithm  by  making  contributions  in  the  noise  analysis  of  the  algorithm  and  methods  of 
accelerating  the  convergence  of  the  adapting  weights.  Gabriel  [14]  gives  an  excellent  introduction  to 
adaptive  arrays. 

The  subject  of  this  report  is  the  noise  analysis  of  the  Applebaum  algorithm.  A  review  of  the  tran¬ 
sient  analysis  involving  this  algorithm  is  presented  in  Section  II.  In  previous  analysis  [3,11,13,14],  the 
noise  field  was  assumed  statistically  stationary  and  fluctuating  much  more  rapidly  than  the  adapting 
weights.  This  implied  that  the  instantaneous  output  weighting  vector  was  independent  of  the  instan¬ 
taneous  input  noise.  Hence,  the  expected  value  of  their  multiplicative  vector  product  (which  occurs  in 
the  implementation  of  the  algorithm)  could  be  separated  into  a  product  of  expected  values.  This 
simplified  the  transient  analysis  of  the  algorithm  considerably.  Bershad  [15]  extended  the  noise  analysis 
of  the  algorithm  by  lifting  the  restriction  that  the  output  process  is  independent  of  the  input  process. 
He  modelled  the  input  data  as  white  noise  processes  and  the  adaptive  weight  process  (output  process) 
as  a  vector  Markov-diffusion  process.  These  assumptions  lead  to  a  Fokker-Planck  equation  for  the  joint 
probability  density  function  (p  d  f.)  of  the  adaptive  weights  from  which  equations  for  the  first  and 
second  moments  are  derived.  However,  most  often  these  equations  are  difficult  to  solve  in  closed  form 
and  thus  measures  of  the  adaptive  filter’s  performance  such  as  the  settling  time  or  time  constants  of  the 
weights,  control  loop  noise,  and  cancellation  ratios  of  sidelobe  noise  are  not  derivable. 

In  this  report,  techniques  that  yield  closed  formed  expressions  for  the  first  moment  of  the  weight¬ 
ing  vector  are  presented  for  when  the  external  noise  sources  are  not  necessarily  stationary  and  can  vary 
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at  any  rate.  Hence,  solutions  for  time  constants,  control  loop  noise,  and  sidelobe  cancellation  ratios  can 
be  derived  exactly.  The  technique  models  the  external  noise  sources  as  continuous  state  jump  Markov 
processes  [16]  that  modulate  a  carrier  frequency.  Section  Ill  discusses  the  merits  of  modelling  input 
noise  in  this  manner  and  shows  for  example  that  the  spectrum  of  a  colored  Gaussian  noise  process  can 
be  replicated  by  a  continuous  state  jump  Markov  process.  Section  III  also  discusses  the  theory  of  linear 
stochastic  differential  equations  (D.E.)  where  it  is  shown  that  the  first  moment  of  the  weights  is  deriv¬ 
able  from  an  integro-differential  equation. 

Section  IV  examines  the  case  when  the  adaptive  array  is  subjected  to  just  one  external  noise 
source.  The  first  moment  of  the  adapting  weights  is  derived  exactly,  and  the  related  time  constants  are 
found.  In  this  section,  it  is  also  shown  that  these  generalized  results  reduce  to  the  results  that  were 
obtained  by  past  researchers  [3,13,14]  under  the  restricting  assumption  that  the  input  noise  varies  much 
more  rapidly  than  the  output  weighting  vector. 

11.  TRANSIENT  ANALYSIS  OF  THE  APPLEBAUM  ALGORITHM 
IN  WIDEBAND  NOISE 

Applebaum  [3]  laid  the  foundations  of  adaptive  array  processing.  Up  until  his  work,  pre-1964,  the 
pattern  of  an  antenna  array  was  steered  by  applying  linear  phase  weighting  across  the  array  and  shaped 
by  constant  amplitudes  and  phase  weighting  the  output  of  the  array  elements.  These  weights  are 
chosen  a  priori  so  as  to  produce  a  pattern  that  is  a  compromise  between  resolution,  gain,  and  low 
sidelobes.  Applebaum  discovered  a  relatively  simple  algorithm  which  allows  the  weights  to  change 
adaptively  in  a  time-varying  noise  environment.  His  "control  law"  attempts  to  vary  the  array  weights 
dynamically  such  that  the  steady  state  signal  to  noise  ratio  of  the  array  output  in  any  spatial 
configuration  of  noise  sources  is  maximized. 

Because  by  definition,  the  array  is  optimized  in  the  steady  state,  it  will  take  the  array  weights  a 
certain  period  of  time  to  approach  their  steady  state  optimum  values.  Thus  there  are  time  constants 
inherent  to  the  adaptive  process.  In  this  section,  we  present  the  transient  analysis  of  the  Applebaum 
algorithm  when  the  input  noise  is  wideband  or  equivalently  when  the  input  noise  is  fluctuating  much 
more  rapidly  than  the  adjusting  weights.  For  a  more  detailed  presentation,  see  Gabriel  [14]. 

We  will  now  consider  a  linearly  weighted  phased  array  as  seen  in  Fig.  1.  Let  </,(/),  q2{t) . 

<7 \(f)  denote  the  output  received  by  an  A-element  antenna  array,  and  Qr  =  ( </ 1 .  q2 . 9,\)  where  T 

denotes  the  transpose.  We  will  assume  that  Q  is  the  sum  of  a  desired  signal  vector  S  and  a  noise  vector 
V.  The  noise  F  could  consist  of  jammers,  clutter,  atmospheric  noise,  or  internal  receiver  noise.  Let  W 
be  a  column  vector  of  complex  weights  that  multiplies  Q  to  form  the  product  WTQ.  The  weights  W 
can  be  adjusted  based  on  some  optimization  criteria  to  enhance  the  detection  of  a  desired  signal  embed¬ 
ded  in  noise.  The  direction  of  arrival  of  the  desired  signal  is  assumed  known.  Let  5  represent  a 
column  vector  of  relative  desired  signal  phases  with 

Sr  =  (eJ*\  e*1 . e'*A).  (2.1) 

For  a  linear  array  with  element  spacing  d  and  a  signal  arriving  from  an  angle  < b  with  respect  to  the  array 
normal  (see  Fig.  2), 

<t>„  -  (27Trt<//\) sinifr 

where  A  is  the  wavelength  and  n  -  1 ,  2 . N. 

The  output  desired  signal  power  of  WTQ  is  proportional  to  |  Ifysl2.  It  is  assumed  in  all  foregoing 
analysis  that  the  input  signal  S  does  not  contribute  significantly  to  the  covariance  matrix  of  the  input  Q. 
This  assumption  is  valid  for  most  pulsed  radars  where  the  signal  duration  is  short  compared  to  the  pulse 
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Fig  2  —  Implementation  of  Applebaum  adaptive  algorithm 


repetition  period.  It  may  also  be  true  in  cases  where  the  external  interference  is  a  man-made  jammer 
and  the  received  power  of  the  jammer  is  much  greater  than  the  received  power  of  the  desired  signal. 
For  radars,  this  might  occur  because  of  the  one-way  path  of  the  jammer  signal  versus  the  two-way  path 
of  the  desired  signal.  The  output  power  Pf,  of  the  array  then  is 

E\WtV\1-  W'tMW  (2.2) 

where  E  denotes  expectation  and  M  is  the  covariance  of  the  noise  process  with  elements 
The  input  process  is  assumed  wide  sense  stationary,  and  hence  M  is  independent  of 

time. 
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The  steady  state  output  signal-to-noise  ratio  can  be  written  as  a  proportionality  or 

a__  1 

N  W‘rM  W  ' 


(2.3) 


It  is  shown  in  Ref.  3  that  the  set  of  weights  that  maximizes  the  signal-to-noise  ratio  is 

Wop,=  k\rxS*  (2.4) 

where  k  is  an  arbitrary  constant. 

A  functional  block  diagram  of  an  implementation  of  the  Applebaum  adaptive  receiving  array  is 
seen  in  Fig.  2.  This  algorithm  attempts  to  adjust  the  weighting  vector  W(t)  such  that  the  steady  slate 
signal  to  noise  power  ratio  (S/ N)  is  maximized. 

It  can  be  shown  [1 1]  that  this  adaptive  array  is  described  by  the  differential  equation 

dW 

r  —  +  (gM  4-  /)  W  =  gS*  (2.5) 


where  r  is  the  time  constant  of  the  low  pass  filter  in  each  loop,  g  is  amplifier  gain  in  each  loop,  /  is  an 
identity  matrix,  and 

M  =  V*  F, .  (2.6) 

The  matrix  M  is  called  the  instantaneous  convariance  matrix  with  elements  that  are  random  variables. 
Equation  (2.5)  is  a  stochastic  linear  differential  equation  with  the  stochastic  input  M  and  the  stochastic 
output  W. 

If  the  input  process  is  fluctuating  much  faster  than  the  output  process,  then  we  can  write 

E\M  W)  =  E\M)E\W\~  M  W.  (2.7) 


This  would  be  the  case  where  the  control  loop  bandwidth  is  much  smaller  than  the  bandwidth  of  the 
input  noise  vector  V. 

If  we  take  the  expected  value  of  both  sides  of  Eq.  (2.5)  and  use  Eq.  (2.7),  then 

r  W  +  (gM  +  l )  W  «  gS*.  (2.8) 


Because  Mis  Hermitian,  there  exists  a  unitary  transformation  /’which  diagonalizes  M  or 

PMP  1  =  ,\  (2.9) 

where  A  is  a  Ax  N  diagonal  matrix  with  elements  k  „  equal  to  the  eigenvalues  of  M.  If  we  let  )  =  PW 
and  )'/  =  (>’|.v2 . V\),  then  Eq.  (2.8)  reduces  to 

t  Y  +  (g\  +  /)  Y '  =■  gR  (2.10) 


where  R  =  PS*,  and  the  initial  condition  is  K(0)  =  PlVj).  The  solution  for  y„  is 


+  >'„«»  - 


+  — 


rn  -  +  1  I 

"  g 
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where  RT  =  U\,r2,  .  rN).  The  transient  solution  of  the  array  weights  is  obtainable  from  Eq.  (2.11) 

and  the  relationship  W  —  P  l  Y.  If  we  examine  Jf'as  /—  it  can  be  seen  from  Eq.  (2.11)  assuming 
g\  n  »  1  for  all  n,  that  y„  —  r„/A„  and  W—  M~]  S*  which  is  the  optimal  solution  that  we  are  seeking. 

The  time  constants  associated  with  Eq.  (2.11)  are 

. *  «•'» 


where  A„  are  the  eigenvalues  of  M.  Thus  the  smallest  eigenvalue  of  A/,  Amin  determines  how  fast  the 
adaptive  array  converges  to  its  optimal  weights.  Each  weight  is  a  sum  of  exponentials  whose  time 
constants  are  r,.  From  Eq.  (2.12)  it  can  be  seen  that  to  speed  up  convergence,  one  can  either  decrease 
r  or  increase  g.  However,  Brennan  et  al.  (Ill  showed  that  this  increases  the  control  loop  noise  power 
of  the  adaptive  filter. 

The  brief  summary  of  results  presented  in  this  section  on  the  time  constants  of  the  Applebaum 
adaptive  algorithm,  was  derived  under  the  restrictions  that  (1)  the  input  process  is  varying  much  more 
rapidly  than  the  output  process  and  (2)  the  input  process  is  stationary,  i.e.,  Mis  a  constant.  In  the  fol¬ 
lowing  sections,  the  Applebaum  algorithm  will  be  analyzed  when  these  restrictions  on  the  input  noise 
process  are  lifted.  We  impose  some  restrictions  on  our  noise  model,  described  in  the  next  chapter. 
However,  this  noise  model  allows  us  to  examine  the  previously  difficult  problem  of  the  derivation  of 
time  constants  for  the  adaptive  weights  in  a  noise  environment  that  is  not  necessarily  wideband. 


III.  NOISE  MODELS  AND  STOCHASTIC  LINEAR  DIFFERENTIAL  EQUATIONS 
A.  Introduction 


The  Applebaum  adaptive  algorithm  expressed  by  Eq.  (2.5)  is  a  stochastic  linear  differential  equa¬ 
tion  because  of  the  stochastic  input  vector  V.  The  standard  methodology  used  to  study  its  performance 
in  noise  is  to  derive  the  first  and  second  moments  of  the  weighting  vector  W  and  to  analyze  perfor¬ 
mance  measures  such  as  time  constants  and  excess  noise  power  due  to  weight  jitter  as  a  function  of  the 
parameters  of  this  equation.  If  we  assume  that  the  nth  component  of  V  consists  of  internal  receiver 
noise  t)„  plus  the  sum  of  M  external  narrow  band  noise  sources,  then  vn  can  be  expressed  as  [141 


(/)  -  rj„(f)  +  £  Xk(t)e  *  *  *  ;  n 

fc—  t 


I . A 


(3.1) 


where  <t>k  —  (2wd/A)  sin  A*,  A  is  the  wavelength  of  the  carrier,  rf is  the  antenna  element  spacing,  9k  is 
the  spatial  location  angle  of  the  Ath  source  measured  from  the  boresight,  Xk(f)  is  the  random  amplitude 
modulation  of  the  Ath  source,  and  |  k  +  <!>*(/)  is  the  random  phase  of  the  Ath  source  which  consists  of 
a  stochastic  component  d>*(/)  and  a  nonstochastic  component  £*.  In  the  analysis  to  follow,  we  assume 
that  i?„(r)  =  0,  so  as  to  highlight  the  effect  of  the  external  noise  sources  on  the  adaptive  processor. 


The  random  amplitude  modulation  of  the  Ath  source,  T*(r),  is  a  stochastic  process  and  can  be 
modelled  in  a  variety  of  ways.  Let  us  just  consider  a  single  source  with  stochastic  amplitude  modula¬ 
tion  equal  to  X(,r).  For  example,  if  the  amplitude  XU)  is  modelled  as  a  Markoff  diffusion  process, 
then  the  first  moment  <  M/(r)>  can  be  formulated  as  the  solution  of  a  nonrandom  partial  differential 
equation  of  the  Fokker-Planck  type  [171.  However,  this  equation  is  most  often  exceedingly  difficult  to 
solve  because  of  a  diffusion  term  (2nd  derivitive  with  respect  to  the  spatial  coordinate).  The  methodol¬ 
ogy  used  in  this  dissertation  is  to  model  the  input  noise  amplitude  modulation  as  a  continuous  state 
jump  Markoff  process  (CSJMP)  [161.  If  X(r )  is  a  CSJMP,  then  .¥(/)  is  discontinuous  with  the  states 
of  .V(r)  changing  abruptly  by  jumps  as  illustrated  in  Fig.  3(a). 
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The  amount  of  time  t  that  X(t)  remains  in  a  given  state  is  a  random  variable  and  hence  can  be 
characterized  by  a  distribution  function  (for  instance,  Poisson  increments).  The  successive  state  of 
X(t)  is  determined  by  a  probability  distribution.  By  controlling  these  two  distribution  functions,  we 
find  that  continuous  time  noise  processes  can  be  modelled.  For  example,  if  we  choose  the  average 
value  of  T small  such  that  <  t >  >>  B,  where  B  is  the  bandwidth  of  the  adaptive  processor  and  also 

choose  a  probability  distribution  function  which  forces  a  successor  state  to  be  highly  correlated  with  its 
current  state,  then  the  sudden  jumps  of  the  input  process  will  not  affect  the  output  process  W(t)  and 
time  continuous  correlated  noise  can  be  simulated  as  seen  in  Fig.  3(b). 

More  importantly  though,  we  find  in  the  following  sections  that  the  probability  and  first  moment 
functions  that  result  when  this  type  of  modelling  is  used  can  be  formulated  as  the  solutions  of  integro- 
differential  equations  which  are  sometimes  readily  solvable.  Thus  an  analysis  of  parametric  variations 
in  the  adaptive  algorithm  is  possible. 

B.  Noise  Model  for  Continuous  State  Jump  Markov  Process 

Kolmogorov  (18]  and  Feller  [161  laid  the  foundations  of  the  theory  of  jump  processes.  Both 
authors  were  concerned  with  the  purely  discontinuous  process  where  the  state  remains  unchanged 
between  jumps.  Modern  texts  which  consider  the  subject  are  Srinivasan  [19],  Bharucha-Reid  [20],  and 
Prabhu  [2 1 1.  We  introduce  the  topic  by  using  the  terminology  of  Prabhu. 

Let  the  stales  (possit'e  values)  of  the  process  X(t)  belong  to  the  real  number  line 
(— oo  <  X  <  ^  >.  Let  the  isition  distribution  function  P(x.  f|x0,  r0)  be  defined  by 

ryx.  f!x0.  to)  ”  Pr\X(l)  ^  x|T(f0)  “  x0!  '•  <  t)  (3.2) 
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and 


P( x.  t\x0.  t)  =  m(x  —  x0) 


(3.3) 


where  m(  )  is  the  Heavyside  step  function. 

We  require  also  that  P(x.  r|x0.  t0)  satisfy  the  Chapman-Kolmogorov  equations  and  now  define  a 
purely  discontinuous  process  as  one  in  which  1)  if  XU)  =  x,  then  a  probability  1  -  c(.v,  /)4(+  O(Af) 
that  there  is  no  change  of  state  (,X(t)  remains  constant  during  [/.  i  +  A r),  and  2)  if  there  is  a  change 
of  state,  then  the  distribution  function  of  X(i  +  At)  is  given  by  Il(x.  x'\  i )  +  O(At).  The  function 
c  (x,  t )  can  be  interpreted  as  the  "jump  rate.”  We  can  use  c(x,  r)  to  control  how  often  the  process 
switches  states:  the  larger  the  value  of  c(x.  /),  the  more  rapidly  the  process  is  state  jumping.  The 
function  ri(x.  x t)  is  actually  a  conditional  probability  distribution  conditioned  on  x.  The  distribution 
function  II  (x,  x';  /)  will  be  used  to  control  the  relative  correlation  between  successive  states.  Both 
c(x,  t)  and  H(x.  x';  /)  determine  the  correlation  function  of  the  process.  For  our  purposes,  we 
assume  both  functions  are  temporally  independent  with  r(x)  =  r(x.  /)  and  ri(x,  x';  i)  =  II (x.  x') 
and  that  both  are  continuous  with  0  <  c(x)  <  In  addition,  we  assume  that  XU)  is  a  second  order 
process  (bounded  variance). 


If  we  define  p(x.  x0;  i.  t0)  to  be  the  joint  p.d.f.  of  T(r)  and  T(r0),  and  p(x.  /)  to  be  the  single 
variable  p.d.f.  of  X(t)  at  any  time  t,  then  it  is  shown  in  Ref.  22  that 

p(x.  x0,  /.  r0)  =  -  c(x)p(x,  x0;  t.  i0) 


c(x')ir(x\  x)p(x x0;  t,  t0)dx' 


(3.4) 


I.C.:  p(x,  x0:  t0.  t0 )  -  p(xQ,  r0)8(x  -  x0) 

and 

~r p(x,  t)  -  -  c(x)p(x,  r)  +  f  c(x')7r(x',  x)p(x',  t)dx'  (3.5) 

at 

I.C.:  p(x,  t0)  given 
where 

tr(x'.  x)  “  n(x',  x).  (3.6) 

ox 

The  function,  n(x'.  x),  will  be  called  the  transition  p.d.f.  of  the  process. 

In  the  following  analysis  we  assume  that  the  process  begins  in  equilibrium.  That  is,  if  we  assume 
the  existence  of  the  limit  and  define 

p»(x)=  limp(x.  /),  (3.7) 

f—  oo 

then  we  will  let  p(x.  0)  or  simply,  Po(x)  —  p„(r).  The  reason  for  making  this  assumption  is  that  as 
f  —  oo,  the  input  process  becomes  stationary.  Hence,  we  can  derive  a  steady  state  spectrum.  Setting 
p0(x)  =  p„(x)  simply  makes  the  process  stationary  at  t  —  0.  We  use  the  steady  state  spectrum  of  the 
jump  input  process  to  match  the  spectrum  of  a  time  continuous  stochastic  process  in  the  next  section. 
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Let  us  formulate  p„(x)  when  c(x)  =  c0,  where  t'u  is  a  constant.  Starting  with  Eq.  (3.5),  we 
recognize  that  as  /  —  °o,  the  lime  derivative  seen  in  Eq.  (3.5)  goes  to  zero.  Cancelling  cu  from  the 
resultant  equation,  we  obtain 


PoAx)  =  I  n  (x  x)paa(x  ’)dx  ' 

•J  -  oo 


(3.8) 


Now  if  w(x',  x)  is  independent  of  x',  i.e. ,  the  next  state  of  the  process,  A'(r),  is  independent  of 
the  current  state,  then  it  is  easily  seen  from  Eq.  (3.8)  that  p^(x)  =  7r(x)  where  ir(x'.  x)  **  n(x). 
Thus  we  see  that  the  steady  state  p.d.f.,  p«,(x),  is  simply  the  transition  p.d.f.,  n(x).  We  call  this  kind 
of  CSJMP,  pseudo  white. 

Let  us  consider  a  CSJMP  where  the  joint  p.d.f.  of  X(i0 )  and  its  next  state  X(i)  is  a  symmetric 
function,  p(x'.  x)  =  p(x.  x').  The  single  variable  p.d.f.,  p(x),  and  p(x',  x)  are  related  by  the  equa¬ 
tions:  p(x'.  x)  —  it  (x\  x)p(x')  and 

p(x',  x)dx' =  f  tr(x',  x)p(x')dx'.  (3.9) 

«/  — oo 


p(x)  -  /_ 


Thus  comparing  Eq.  (3.9)  with  Eq.  (3.8),  we  see  that  p»(x)  =  p{x).  Therefore  to  find  Poo(x),  we 
merely  integrate  p(x\  x)  over  all  of  x'.  For  example,  let  us  define  tr(x',  x)  to  be  the  Gaussian  condi¬ 
tional  p.d.f. 


ir  (x',  x)  = 


1 


or  (2w(l  —  p2)) 


1/2 


exp- 


2tx 2(1  -  p2) 


(x  -  px')2 


(3.10) 


If  p(x',  x)  is  symmetric,  then  Eqs.  (3.8)  and  (3.9)  imply  that 

,  x  I  1  , 

p»(x)  =  — exp-  — —x. 


(3.11) 


Hence  p«,(x)  is  a  Gaussian  p.d.f.  We  will  call  noise  with  a  transition  p.d.f.  given  by  Eq.  (3.10),  a 
colored  Gaussian  CSJMP  Note  that  the  parameter  p  in  Eq.  (3.10)  can  be  used  to  control  the  degree  of 
correlation  between  successive  states. 


If  we  force  the  input  noise  process  to  begin  in  equilibrium,  i.e.,  p0(x)  =  p„(x),  then  we  can 
show  that  the  solution,  p(x.  /)  in  Eq.  (3.5)  is  simply  p(x,  r)  =  p«,(x).  Hence,  the  single  variable 
p.d.f.  function  p(x,  /)  is  independent  of  lime  if  the  noise  process  begins  in  equilibrium. 

C.  Power  Spectrum 


It  is  shown  in  Ref.  22  that  the  power  spectrum  of  the  noise  process,  T(r),  for  when  the  process  is 
in  equilibrium,  c(x)  =  c0  where  c0  is  a  constant,  and  n(x'.x)  has  the  form  (see  Eq.  (3.10)  for  exam¬ 
ple) 


is  (also  see  Fig.  4) 


IT  (x  x)  —  IT  (x  -  px  ') 


Sx  (id  )  “ 


2c0(l  -  p)«x2 

w 2  +  cn2  (1  -  p)2 


(3.12) 

(3.13) 


Thus  we  see  from  Eq.  (3.13)  that  a  first  order  base  bandlimited  spectrum  of  a  given  continuous 
random  process  may  be  matched  or  modelled  by  a  CSJMP  by  choosing  c0  and  p  properly.  We  would 
seem  to  have  one  extra  degree  of  freedom  in  matching  the  spectrum.  However,  other  considerations 
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such  as  for  instance  making  the  adaptive  receiver  insensitive  to  the  sudden  jumps  have  to  be  weighed 
in  choosing  c0  and  p.  We  can  show  that  the  average  time  T that  X(t)  is  in  a  given  state  is  cq Thus, 
it  may  be  desireable  to  make  c0  >  >  fi,  where  B  is  the  bandwidth  of  the  adaptive  receiver. 


D.  First  Moment  of  a  Stochastic  Linear  Vector  Differential  Equation 

Let  us  consider  a  stochastic  linear  vector  D.E. 

/1W 

2---  F(X(t).  t)W(t)  +  t)  (3.14) 

at 

I.C.:  IF(O)- 

It  is  shown  in  Ref.  22  that  if  X(t)  is  a  CSJMP,  then  the  first  moment  of  the  weights  <  lF(f)>  can  be 
formulated  by  the  following  equations: 

~  y{x,  i)  -  f  c(x)n(x',  x)y(x',  t)dx'  -  c(x)y(x.  t ) 
dt  J-t> 

+  F(x,  t)y(x.  t )  +  G(x.  t)p(x,  t )  (3.15) 


I.C.:  y(x.  0)  -  p(x.  0)  W0. 

<  W(t)>  -  v(x.  t)dx.  (3.16) 

Hence,  we  first  find  v(x,f)  by  using  Eq.  (3. IS)  and  then  integrate  y(x.r)  which  yields  <  IF(r)>. 
We  use  Eqs.  (3.15)  and  (3.16)  in  Section  IV  to  analyze  the  Applebaum  adaptive  algorithm  when  the 
input  noise  is  a  single  interfering  source  generating  a  CSJMP. 

IV.  PARTICULAR  SOLUTION  FOR  A  SINGLE  INTERFERENCE  SOURCE 
A.  Introduction 

In  this  section  we  consider  the  case  when  the  adaptive  receiver  is  being  interfered  with  by  just  one 
external  noise  source.  We  consider  this  to  be  the  only  source  of  interference,  internal  or  external,  so 
as  to  highlight  the  effect  of  a  single  noise  source  on  the  adaptive  filter  and  to  demonstrate  the  noise 
analysis  techniques  presented  in  the  previous  section.  We  represent  the  noise  source’s  signal  as  the 
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scalar  X(t)e'"{'\  where  T(t)  is  the  stochastic  amplitude  modulation  anda(t)  is  the  random  phase  of 
the  noise  source.  The  amplitude  modulation  X(t)  is  modelled  as  a  CSJMP.  For  a  single  noise  source, 
the  noise  power  of  XU)  is  measured  at  the  adaptive  receiver  and  not  the  noise  source's  transmitter. 
Also,  the  noise  source  is  assumed  spatially  stationary  (it  does  not  move).  Furthermore,  the  noise 
source’s  voltage  X(t)  is  assumed  narrowband  with  respect  to  its  carrier  frequency  so  that  the  input 
noise  vector  F(r)  is  simply  AX(t)e'aU>,  where  A  =  (e1*1,  e'*2  ...  e 14 s)  indicates  the  direction  of 
arrival  of  the  input  interference  and  is  essentially  constant  (recall  from  Eq.  (3.1)  that  4>„  is  a  function 
of  the  wavelength  of  the  input  signal).  Subsection  B  formulates  the  solution  of  the  first  moment  of  the 
weighting  vector  by  using  the  noise  analysis  techniques  presented  in  Section  111.  Subsection  C  exam¬ 
ines  in  detail  the  time  constants  associated  with  this  weighting  vector.  It  is  shown  that  if  the  input 
noise  bandwidth  decreases,  then  the  settling  lime  or  time  constant  of  the  weighting  vector  increases.  It 
is  also  shown  that  if  the  input  noise  bandwidth  is  finite,  then  the  lime  constant  approaches  a  positive 
definite  limit  as  the  input  noise  power  becomes  large.  The  exact  solution  of  first  moment  of  the 
weighting  vector  is  derived  in  Subsection  D. 

B.  First  Moment  Formulation 

In  this  section,  we  formulate  the  solution  of  the  first  moment  of  the  weighting  vector  of  the  adap¬ 
tive  algorithm  by  using  the  noise  analysis  techniques  described  in  Section  III.  We  use  the  assumptions 
as  noted  in  Subsection  A  of  this  chapter.  To  this  end,  if  we  substitute  AX(i)c'atl>  for  F(r)  in  the 
adaptive  algorithm  (2.5),  we  obtain  the  equation 

lF(t)  +  ^S*.  (4.1) 


l.C.  1F(0)  -  W0. 

Note  that  IF  is  not  a  function  ofa(t).  Let  us  just  consider  the  N  x  A  transition  matrix  solution  [23,  p. 
1311,  'F(r),  of  Eq.  (4.1)  or 

*U)  (4.2) 


dV 

dt 


£x2U)A*At+ 


&X2U)A*AT  +  - l \ 
dt  t  t  J 


l.C.  'P(O)  -  /. 

(t  can  be  shown  that  the  solution  of  Eq.  (4. 1 )  is 

H'(f)-*(/>H'0  + -JoV(/-  t (4.3) 


Taking  the  expected  value  of  both  sides  of  Eq.  (4.3)  yields 

<  !F(f)>  -  <¥(f)>  (F0  +  /J  <VU  -  f,)>  dt,  f  S (4.4) 

Hence  if  an  expression  for  <'F(/)>  is  found,  then  <  W(t)>  can  be  evaluated  simply  by  using 
Eq.  (4.4).  We  use  a  methodology  suggested  by  Lang  and  Pickholtz  [24],  which  reduces  the  number  of 
differential  equations  to  be  solved  from  N 2  (Eq.  (4.2))  to  just  two.  The  technique  takes  advantage  of 
the  form  of  the  matrix  A*Ar.  Let  us  write  the  solution  of  Eq.  (4.2)  in  the  form 

*(r)  -  .4*/(r<Mf)  +  /<Mr)  W.5) 
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where  0,(r)  andi//2(f)  are  scalar  functions  yet  to  be  determined  and  with  initial  conditions 


■M 0)  =  0;  «M 0)  =  1. 


Substituting  Eq.  (4.5)  into  Eq.  (4.2)  yields 


<AI>  i 
dt 


A*At  + 


—  NXHt)  +  - 

T  T 


+  -  xHiH 


A*At  -  2 1. 


(4.6) 

(4.7) 


The  fact  that  A*ATA*AT  =  (ATA*)  (A*AT)  =  N  A*AT  was  used  in  deriving  Eq.  (4.7). 


d4>  | 
~dt~ 


—  NX2(t)  +  -  0,  +  X2(t)<l>2 

T  T  T 


Now  if  we  set 

(4.8) 


d<l)  2 
~dT 


(4.9) 


then  we  see  that  the  solutions  for  0  ( ( r )  andi/i^t)  in  Eqs.  (4.8)  and  (4.9)  will  yield  the  complete  solu¬ 
tion  of  the  transition  matrix  ')'(t)  by  using  Eq.  (4.5).  Thus,  we  have  reduced  the  number  of  D.E.s 
under  consideration  from  N2  to  just  two.  Actually  the  procedure  we  have  used  could  have  been  per- 
formeH  more  systematically  within  the  context  of  algebras  125] .  The  two  matrices,  A*Ar  and  /.  are  said 
to  be  the  elements  of  the  algebra,  and  1 1>  i (/)  and  il>2U)  are  called  structure  constants. 

Now  if  we  know  the  first  moments  of  $ ,  and  >l)2,  then 

<*(/)>  =  A*At  <i Mf)>  +  /<>M')>.  (4.10) 


It  is  seen  that  the  structure  constant,  ih2(t),  may  be  solved  directly  from  Eq.  (4.9)  and  the  initial 
condition  given  in  Eq.  (4.6)  as 

4>2(.t)  -  e~'h .  (4.11) 

Thus  we  have  to  consider  only  the  stochastic  D.E.  given  by  Eq.  (4.8)  or 

«Mr)  +  £x2(t)e~,h  (4.12) 


d<l>  \ 
~dt~ 


NXHt)  +  - 


I.C.:  0,(0)  -  0. 


Our  next  step  will  be  to  determine  <0  ,(/)>.  If  we  model  the  input  noise  to  be  a  CSJMP  with  a 
transition  p.d.f.,  ir(x'.x),  and  jump  rate,  c0,  and  set 


F(X(t).r)  -  -  £  NX2(t)  - 

(4.13) 

T  T 

G(X(t).r)  -  -  ^  *2(f)  e’T. 

(4.14) 

r 


then  we  may  use  Eq.  (3.15)  to  obtain  an  integro-differential  equation  for  the  state  dependent  mean 
density  function  y(x,/).  This  equation  is 


y(x,t)  +  c0  f  tr  (x',x)  y(x',t)dx’  -  p(x.t)  x2  e~,h 

•JR  7 


(4.15) 


I.C.  y(x,0)-0, 
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where  p(x.t)  is  the  single  variable  p.d.f.  of  XU)  and  R  is  the  probability  space  of  x'.  The  total  mean  or 
state  independent  mean,  <i/»  ,(/)>,  is  found  by  using  Eq.  (3.16)  or 

<0  t(r)>  =  y(x,r)  dx.  (4.16) 


Let  us  examine  the  case  when  the  input  noise  is  pseudo-white  and  in  equilibrium  or  irix'.x)  =  n-(x), 
and  pa(x)  =  p„,U)  =  w(x). 


Thus  Eq.  (4.15)  becomes 


~  v(x.t)  =  - 
dt  ' 


g  —  x2  +  ~  +  c0  y(x.l)  +  cQn(x)  J*r  y(x',r)  dx' 


—  it  (x)  —  x1  e~,/r 

T 


(4.17) 


I.C.  y (x, 0)  =  0. 

We  will  now  solve  Eq.  (4.17).  Let  us  define  ^(x.s)  to  be  the  Laplace  transform  of  y(x,r)  and 
G(s)  as 

G(s)=  f  K(x',s)  dx'.  (4.18) 

J  R 


Taking  the  Laplace  transform  of  both  sides  of  Eq.  (4.17)  and  solving  for  K(x.s)  yields 


Y(x.s)  —  K(x.s)ir(x) 


£x> 


CqG(s)  -  — 


s  +  — 
r 


(4.19) 


where 


K(x,s) 


—  Nx 2  +  —  +  c0  +  s 


(4.20) 


Substituting  the  expression  for  Y(x.s)  as  given  in  Eq.  (4.19)  into  Eq.  (4.18)  and  solving  this 
linear  equation  directly  for  G(s)  results  in 


/  e  j  (  x2  K(x,s)rr(x)dx 

G(s)  -  -  - - - ^ ? - . 

r  s  +  —  1  -  c0  J  AC(x,s)w(x)d!x 


(4.21) 


The  expression  for  G(s)  in  Eq.  (4.21)  may  now  be  substituted  into  Eq.  (4.19)  to  find  VTx.s). 

If  we  take  the  Laplace  transform  of  y(x.i)  and  integrate  over  R,  we  obtain  from  Eq.  (4.16)  the 
Laplace  transform  of  <<|»|(f)>.  However,  we  see  from  Eq.  (4.18)  that  this  is  just  G(s).  Hence 

L  |<i)»|(/)>|  -  G(s).  (4.22) 

The  above  can  be  evaluated  by  using  the  expression  seen  in  Eq.  (4.21).  We  will  now  analyze  in  depth 
the  special  case  when 

c0ir(x)  “  a  U(-b.b)  (4.23) 
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where  U(-b.b)  is  a  rectangular  function  of  unit  height  extending  from  —b  to  b ,  and  a  is  a  constant  pro¬ 
portional  to  the  jump  rate.  From  Eq.  (4.23)  we  see  that  the  transition  p.d.f.  is  uniform  so  that 

tt(x)=  U(—b,b)  ~~  (4.24) 

2b 

and 


c0  =  2  ab. 


(4.25) 


Dividing  U(-b.b)  by  2b  normalizes  the  density  function.  The  region  R  now  extends  from  ~b  to  b. 
Essentially  Eq.  (4.24)  implies  that  the  next  state  of  the  stochastic  process,  Af(r),  is  chosen  from  a  uni¬ 
form  p.d.f.  on  the  interval  (—6.6),  and  that  this  selected  state  is  independent  of  all  previous  values  of 
A '(/).  If  we  set 


/•  ^ 


dx 


s  + 


—  4-  2ab  +  g—  x2 


(4.26) 


then  by  algebraic  manipulation,  we  can  show  that  Eq.  (4.22)  becomes 


or  equivalently 


L{<<M/)>| 


i  n(s) 
2bN  1  -  oft(s) 


N 


<<!>,(/)> 


i  n  (s) 

2bN  |l-flft(s) 


(4.27) 


(4.28) 


C.  Time  Constants 

in  this  section,  we  examine  the  Laplace  transform  solution  of  <\l>\(t)>  in  detail.  Recall  from 
Section  II,  that  measures  of  effectiveness  of  the  adaptive  filter  are  the  time  constants  or  settling  times 
of  the  adapting  weights  Wit).  These  time  constants  are  related  to  the  Laplace  transform  of  <  M/(r)>, 
which  in  turn  is  related  to  the  Laplace  transform  of  <ib,(t)>  through  Eqs.  (4.10)  and  (4.4).  From  Eq. 
(4.27)  it  is  apparent  that  the  poles  of  L|<i6t(r)>!  other  than  s  **  —  1/r  will  be  dependent  on  the  func¬ 
tion  (Us).  A  discussion  of  the  function  D  (s)  follows.  It  can  be  shown  that  ft  (s)  is  a  single  valued 
function  of  the  complex  variable  s  and  has  a  line  of  singularities  extending  along  an  interval  on  the 
negative  real  axis  as  seen  in  Fig.  5. 

If  we  set 

d,  -  --  -  2 ab-  d2~-~-  2ab  -  —■  (4.29) 

t  Jr1 


where  r  —  (t /glV)'12,  then  this  interval  is  ld2,d|).  The  function  ft  (s)  is  unbounded  at  the  end  points 
of  this  interval  and  we  can  also  show  that  if  x  6  (d2.d{),  then 


lim  ft  (x  +  jt ) 
« —o* 


b  -  ryu 2 
b  +  rym 


(4.30) 


lim  ft  (x  -  jt ) 
«-  o* 


b  -  ry'12 
b  +  ryU2 


+  J 


it  r 


(4.31) 


13 


K  GERLACH 


Fig.  5  —  The  function  1)  (s) 


where  y  =  J\  -  x.  Equations  (4.30)  and  (4.31)  demonstrate  the  discontinuous  nature  of  11  (s)  on  the 
interval  [di.dx\.  The  interested  reader  is  referred  to  Ref.  22  for  proofs  of  these  properties.  The  func¬ 
tion  11  (s)  [I  -  all  (s)!"1,  which  is  part  of  the  solution  of  x(t)>),  will  also  have  a  line  of  singu¬ 
larities  extending  between  the  same  limits  as  seen  in  Fig.  6. 


Fig.  6  —  The  function  ft  (i)  ll  -  aft  (s)l  1 


It  is  seen  that  the  time  constants  of  and  the  weighting  vector  of  the  Applebaum  algorithm 
will  be  dependent  on  the  poles  of  the  function  H(s)  [I  -  aft(s)I~'.  It  can  be  shown  that  this  func¬ 
tion  has  only  one  pole,  X ,  which  satisfies  the  equation 

a  11  (X )  —  1 .  (4.32) 

It  can  be  shown  that  this  pole  is  real  and  is  always  located  on  the  interval 
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Thus  the  pole  is  never  on  the  line  of  singularities  as  seen  in  Fig.  6.  To  show  that  A  <  —  1/r,  we  find 
by  using  Eq.  (4.32)  and  the  definition  of  (1  (s),  Eq.  (4.26),  that 


oft  (A) 


+  A 


+  A 


dx  =  0. 


(4.33) 


Assume  A  ^  —1/r,  then  the  numerator  and  denominator  of  the  integral’s  kernal  seen  in  Eq.  (4.33)  are 
always  greater  than  zero.  Hence,  the  integral  is  always  greater  than  zero  and  Eq.  (4.33)  is  never  true. 
Thus,  A  <  —  1/r.  We  can  use  Eqs.  (4.30)  and  (4.31)  to  show  that  A  does  not  lie  on  the  interval 
[d2.d\\.  From  Eqs.  (4.30)  and  (4.31),  the  function  ft  (s)  has  values  that  have  imaginary  parts  greater 
than  zero  as  we  come  arbitrarily  close  to  the  interval  [d2.d t].  Hence,  along  this  interval,  aft  (A)  -  1 
will  have  a  nonzero  imaginary  part  and  cannot  equal  zero.  We  can  also  use  Eq.  (4.33)  to  show  that  A  is 
not  less  than  d2.  If  this  were  true,  then  the  numerator  and  denominator  of  integral’s  kernal  in  Eq. 
(4.33)  would  both  be  negative.  Hence,  the  kernal  is  always  positive  which  implies  that 
aft  (A )  -  1  >  0.  Thus,  if  A  cannot  be  less  than  d2  and  A  9  [ d2  rft),  then  A  >  dx. 


It  should  be  noted  that  although  ft  (s)  is  unbounded  at  dt  and  d2,  that  ft(s)/(!  -  aft(s))  is 
bounded.  It  can  be  shown  by  using  elementary  limiting  procedures  that 


lim 


ft(s) 

1  -  aft(s) 


\_  . 
a 


/-  1,  2. 


(4.34) 


Integrating  Eq.  (4.26),  we  obtain 


2  r 

b 

- r-[7y  arctan 

A  +  -  +  lab 

r 

A  +  —  +  2  ab 

T7T 

T 

T 

where  arctan  {  |  is  the  principle  branch  of  the  inverse  tangent  function. 


(4.35) 


We  will  define  T0  =  -  I/A  as  the  output  time  constant  of  the  adaptive  process  and  p  =  gN<  Xl> . 
The  parameter  P  will  be  called  the  elemenl-gain-input  noise  power  product  because  it  is  the  multiplica¬ 
tive  product  of  the  number  of  elements  in  the  receiving  antenna’s  array,  the  gain  of  the  receiver’s 
amplifiers,  and  the  input  noise  power  measured  at  the  receiver's  front  end. 


To  better  understand  the  nature  of  the  adaptive  processor’s  time  constant  let  us  substitute  the 
expression  for  11(A)  given  in  Eq.  (4.35)  into  Eq.  (4.32)  and  rewrite  Eq.  (4.32)  as  a  function  of  P  and 
the  following  normalized  parameters:  T  —  T/t ,  and  TJt  where  T  is  the  average  switching  time 
of  the  input  noise  ( T  —  l/c0).  This  equation  becomes 


_ 1 _ 

13)3  rJ(l  -  Tq  1  +  T  ')Vn 


arctan 


3g 

1  -  T0  '  +  T  ' 


(4.36) 


The  parameters  T  and  f0  will  be  called  the  normalized  average  switching  time  and  the  normalized  time 
constant  of  the  adaptive  output  process,  respectively.  Both  are  normalized  to  the  time  constant  associ¬ 
ated  with  the  adaptive  receiver’s  integrators  seen  in  Fig.  2.  If  we  plot  Ta  versus  P  for  various  contours 
of  Tby  using  Eq.  (4.36),  we  obtain  curves  as  seen  in  Fig.  7.  Note  that  ^appears  to  be  a  monotoni- 
cally  decreasing  function  of  p  and  a  monotonically  increasing  function  of  T.  Using  the  properly  that 
d2  <  A  <  -1/t,  we  can  show  that 

— <  r„  <  1 .  (4.37) 

1  +  T 
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0 

Fig.  7  —  Normalized  lime  constant,  f0,  vs  T  and  /3 


and  that  as  /3  — >  °o,  the  normalized  time  constant,  T0,  approaches  the  lower  bound  of  the  above  ine¬ 
quality.  It  is  significant  to  note  that  past  researchers  (111  have  derived  T0  versus  0  for  when  f  =  0. 
We  see  from  Fig.  7  that  this  assumption  that  the  input  noise  is  varying  infinitely  fast  results  in  an  upper 
bound  on  the  performance  in  terms  of  minimizing  the  time  constant  of  the  adaptive  processor.  Also, 
past  researchers  [11,141  implied  that  as  the  input  noise  power  becomes  large  (or  0  —  °°)  that  the  out¬ 
put  time  constant  goes  to  zero.  We  see  from  Fig.  7  that  this  is  not  the  case  for  nonzero  T.  As  the 
input  nojse  power  becomes  large,  the  normalized  time  constant  approaches  a  lower  bound  equal  to 
77(1  +  T). 

To  give  the  reader  some  practical  insight  into  the  meaning  of  the  time  constant  curves  seen  in 
Fig.  7,  consider  the  example  illustrated  in  Fig.  8.  Here,  we  show  (Fig.  8(a))  a  sample  realization  of  the 
amplitude  modulation  noise,  X(l),  which  is  a  CSJMP  with  T=  1.  Figure  8(b)  is  sample  plot  of  the 
magnitude  of  the  i  th  element  of  the  output  weighting  vector,  IF(t).  Initially,  I F,(r)  is  in  the  quiescent 
state.  When  a  noise  step  is  applied  at  /  =  t0.  •♦'/(O  adjusts  itself  to  null  out  the  noise  source.  At  t  - 
th  the  input  noise  power  is  decreased  and  again  the  weight  element  adjusts  itself.  Note  that  the  time 
constant  T0(r0)  is  greater  than  Fo^t)-  This  can  be  explained  by  using  Fig.  7.  Because  the  input  noise 
power  is  greater  at  t0  than  at  r,,  we  see  from  Fig.  7  that  T0lr0)  >  7o(/j)  and  hence  T0(t0)  >  r0(f|). 
The  weight  I F,(r)  will  approach  its  optimum  value  after  some  period  of  time.  The  curves  of  Fig.  7 
imply  that  it  will  reach  this  optimum  value  (with  arbitrary  accuracy)  faster  if  the  input  noise  power  is 
larger.  In  addition,  if  the  fluctuations  are  more  rapid  (say  T  =  0.5),  ^(r)  will  reach  its  optimum  value 
faster. 

If  we  expand  fa  in  a  Taylor  series  as  a  function  of  small  ?,  we  can  show  that  (221 

f“--nbf|l  +  ?  TTif  f+orr4  (4J81 
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RETURNS  TO 


Fig.  8  —  Inpui/ouiput  example 


It  is  seen  from  Eq.  (4.38)  that  F0  can  be  approximated  to  a  first  order  term  in  Fif 

F«^-V-r.  (4.39) 

Equation  (4.39)  also  specifies  the  bounds  of  the  validity  of  the  often  used  assumption  that  the  input 
noise  process  is  varying  much  faster  than  the  output  process.  For  0  »  1.  this  assumption  is  valid 
when  F  «  t/0  or  equivalently  when  the  input  noise  bandwidth  B,„  »  rN<  X>2/(itt). 

From  Eq.  (4.38),  we  see  that  Tn  and  hence  the  time  constant  of  the  output  process  increases  for 
small  F.  In  fact,  it  is  shown  in  Ref.  22  that  the  time  constant  is  a  minimum  as  F  —  0  or  equivalently 
when  the  input  process  varies  infinitely  fast. 

If  the  input  noise  is  varying  infinitely  fast  or  F  =  0,  we  see  from  Eq.  (4.38)  that  F()«  1/(1  +0). 
It  is  interesting  to  compare  this  result  if  the  normalized  time  constant  is  acquired  by  the  methodology 
used  in  Section  II.  If  we  take  the  expected  value  of  both  sides  of  Eq.  (4.12)  and  assume  that  the  input 
is  varying  much  faster  than  the  output  such  that  <  X!<b  \  >  =  <  X2>  <i/» ,  > ,  then 

d-~r>-  ■  -  |—  <x}>  +  -]  <!//,(/)>  +  -  <X:>  e  ,h.  (4.40) 

dt  |  T  T  J  T 


17 


K  GERLAC'H 


From  Eq.  (4.40),  it  is  apparent  that  the  eigenvalue  is 

A  =  -  —  <  X2>  -  — .  (4.41) 

r  t 

and  hence  the  normalized  time  constant  is  1/(1  +  0).  This  agrees  with  the  result  obtained  by  our  pre¬ 
vious  methodology. 

D.  Exact  Solution  for  First  Moment 

In  this  subsection,  we  obtain  an  exact  expression  for  the  first  moment  <  H'  (r)>  of  the  weighting 
vector  for  our  specific  example:  adaptive  processing  when  there  is  only  one  external  noise  source  which 
generates  a  pseudo-white  CSJMP.  We  examine  <  M/(t)>  in  the  steady  state  (/  — *«>)  and  compare 
this  result  with  the  solution  that  is  obtained  using  the  assumption  that  the  input  noise  is  fluctuating 
much  faster  than  the  output  process,  IF(r). 

We  now  find  the  first  moment  <  M/(/)>  of  the  weighting  vector  by  using  Eq.  (4.28).  To  start 
with,  the  complex  function  ft  (s)  [1  -  aft(s)l_l  has  a  line  of  singularities  on  the  negative  real  axis; 
thus  part  of  the  solution  of  <i h,(/)>  will  be  in  the  form  of  a  real  integral.  Reference  22  evaluates  the 
inverse  Laplace  transform  of  ft  (s)  (1  —  aft(s)l_l  jn  terms  of  t,  a.  A/,  g,  and  b.  If  we  substitute  for 
these  parameters  the  defined  parameters  T,  0,  and  T0>  then  ZT1  {ft  (s)  [1  -  aft(s)]'1)  may  be  shown 
to  be 

L~[  |ft(s)ll  -  aft  (s)]"'| 

_ to2  e 

60  f-  In 


26 


r°T  +  (60  T)2  e 


Jo 


doj 


1  -  , 


1  +, 


+  IT* 


(4.42) 


The  second  term  in  the  large  brackets  is  due  to  line  of  singularities  on  the  [d2.d\]-  Note  that  as 
T  —  0,  the  second  term  goes  to  0.  Thus,  the  integral  seen  in  Eq.  (4.42)  does  not  contribute  to 
<i/i|(r)>  when  the  input  is  fluctuating  infinitely  fast. 

Our  original  intentions  were  to  find  the  first  moment  <  M/(r)>  of  the  adapting  weight  vector. 
This  can  now  be  done  by  substituting  the  expression  for  L  l  {ft(s)[l  -  aft(s)l-1}  seen  in  Eq.  (4.42) 
into  Eq.  (4.28)  which  yields  a  complete  solution  for  <i/> j (r)>  .  Then  the  first  moment  <,E(f)>  of  the 
transition  matrix  can  be  found  by  using  Eq.  (4.10)  and  recognizing  that  <il»2(f)>  =  e',/r.  This  expres¬ 
sion  for  <'!'(/)>  is  then  substituted  into  Eq.  (4.4)  which  yields 


C  lE(r)>  =  \~A'Ar 


e  7  -  1  +  7*0(1  -  e  V )  +  (60  T)2  f 

•to  r, 


'  «*(1  -  e~,'lwU)d'» 


(<a)r2(u>) 


dw 


+  /(!-*  T)  S*g 


where 


r,(<o)  -  30aj2  +  1  +  T 


r2(w) 


60  T  -  In 


I  - 


1  +  to 


+  n* 


(4.43) 

(4.44) 

(4.45) 
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If  we  consider  the  steady  state  value  of  the  weighting  vector  and  denote  this  by  =  lim  <  H/(t)>, 

(—00 

then  from  Eq.  (4.43)  it  is  seen  that 


JL  A , 

N  A 


T0-  1  + 


>2du> 


/•|(<u)f2(a)) 


/  S'K 


(4.46) 


where  T0=  T0  (J3.T).  Had  we  derived  under  the  assumption  that  the  input  X(t)  was  fluctuating 
much  faster  than  the  output  (f'(r)  then  it  would  be  found  as  shown  in  Ref.  22  that 

S*g  (4.47) 

where  T0  =  Ta  (/3.0)  =  1/03  +  1).  Equation  (4.47)  was  found  by  taking  the_expected  value  of  both 
sides  of  Eq.  (4.1),  setting  the  time  derivative  equal  to  zero,  and  solving  for  IT«,  by  using  the  matrix 
inversion  lemma  [26l  and  the  assumption  that  <  X2(t)  W  U)>  =  <X2(.t)>  <  >4'(t)>.  We  observe 
that  Eq.  (4.46)  differs  from  the  classical  result,  Eq.  (4.47),_by  (1)  the  contribulion  of  the  line  of  singu¬ 
larities  and  (2)  by  the  fact  that  T^ifi.T)  >  r„(/),0)  for  T  ^  0.  However,  for  T  =  0,  Eq.  (4.46)  is 
identical  to  Eq.  (4.47). 

V.  SUMMARY  AND  CONCLUSIONS 


W„  - 


Ml  (T0-  1)  + 


In  this  report,  we  have  introduced  a  technique  that  yields  closed  formed  solutions  for  the  noise 
analysis  of  the  Applebaum  adaptive  algorithm.  Past  researchers  have  derived  results  under  the  assump¬ 
tion  that  the  input  noise  is  stationary  and  rapidly  varying  with  respect  to  the  output  weighting  vector  of 
the  Applebaum  algorithm.  We  have  extended  this  work  to  include  noise  that  is  not  stationary  and  can 
vary  at  any  rate.  The  technique  models  the  external  noise  sources  as  continuous  state  jump  Markov 
processes  that  modulate  a  carrier  frequency.  The  first  moment  equation  for  the  optimal  weighting  vec¬ 
tor  that  results  is  an  integro-differential  equation  that  is  solvable  in  specific  cases.  In  particular,  we 
have  examined  in  detail  the  case  where  the  adaptive  algorithm  is  subjected  to  a  single  external  noise 
source  whose  modulation  is  a  continuous  stale  jump  Markov  process.  We  found  that  the  assumption 
made  by  past  researchers  [3,13,141  that  the  input  noise  is  rapidly  varying  with  respect  to  weighting  vec¬ 
tor  imposes  an  upper  bound  on  performance.  It  is  shown  in  this  case  that  the  time  constant  of  the 
adaptive  output  process  will  be  minimized.  As  the  input  noise  process  variations  become  slower,  the 
time  constant  of  the  output  process  becomes  larger.  Bounds  on  the  validity  of  the  above  assumption 
are  established  in  Section  IV.  Also  past  researchers  [3,13,14]  implied  that  if  the  input  noise  power 
became  infinite,  then  the  output  time  constant  would  go  to  zero.  We  show  that  for  input  noise  with  a 
finite  bandwidth,  that  the  output  time  constant  approaches  a  positive  lower  bound  as  the  input  noise 
power  becomes  finite. 
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